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Abstract 

Background: To increase the ecological validity of neuropsychological instruments the use of virtual reality (VR) 
applications can be considered as an effective tool in the field of cognitive neurorehabilitation. Despite the growing 
use of VR programs, only few studies have considered the application of everyday activities like shopping or 
travelling in VR training devices. 

Methods: We developed a novel 360°- VR supermarket, which is displayed on a circular arrangement of 8 
touch-screens - the "OctaVis". In this setting, healthy human adults had to memorize an auditorily presented 
shopping list (list A) and subsequently buy all remembered products of this list in the VR supermarket. This 
procedure was accomplished on three consecutive days. On day four, a new shopping list (list B) was introduced 
and participants had to memorize and buy only products of this list. On day five, participants had to buy all 
remembered items of list A again, but without new presentation of list A. Additionally, we obtained measures of 
participants' presence, immersion and figural-spatial memory abilities. We also tested a sample of patients with focal 
epilepsy with an extended version of our shopping task, which consisted of eight days of training. 

Results: We observed a comprehensive and stable effect of learning for the number of correct products, the 
required time for shopping, and the length of movement trajectories in the VR supermarket in the course of the 
training program. Task performance was significantly correlated with participants' figural-spatial memory abilities 
and subjective level of immersion into the VR. 

Conclusions: Learning effects in our paradigm extend beyond mere verbal learning of the shopping list as the 
data show evidence for multi-layered learning (at least visual-spatial, strategic, and verbal) on concordant measures. 
Importantly, learning also correlated with measures of figural-spatial memory and the degree of immersion into the 
VR. We propose that cognitive training with the VR supermarket program in the OctaVis will be efficient for the 
assessment and training of real-life cognitive abilities in healthy subjects and patients with epilepsy. It is most likely 
that our findings will also apply for patients with cognitive disabilities resulting from other neurological and 
psychiatric syndromes. 



* Correspondence: pgrewe@uni-bielefeld.de 

Physiological Psychology, Bielefeld University, P.O. Box 10 01 31, 

Bielefeld D-33501, Germany 

2 CITmed Project, Center of Excellence Cognitive Interaction Technology 
(CITEC), Bielefeld University, P.O. Box 10 01 31, Bielefeld D-33501, Germany 
Full list of author information is available at the end of the article 

O© 2013 Grewe et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative 
BiolVlGCl Central Commons Attribution License (http://creativecommons.Org/licenses/by/2.0), which permits unrestricted use, distribution, and 
reproduction in any medium, provided the original work is properly cited. 



Grewe et al. Journal of NeuroEngineering and Rehabilitation 2013, 10:42 
http://www.jneuroengrehab.eom/content/1 0/1 /42 



Page 2 of 15 



Background 

The lack of ecological instruments in the field of clinical 
neuropsychology has been criticized frequently [1-4]. 
This criticism is particularly relevant in the field of com- 
plex higher cognitive functions such as (autobiograph- 
ical) episodic memory [5-7] and executive functions [8]. 
Among a number of approaches to increase ecological 
validity [9], the use of Virtual Reality (VR) has been in- 
creasingly considered to allow for an ecologically valid 
assessment of everyday cognitive functions [10,11]. Dur- 
ing the last two decades, a growing number of studies in 
the field of clinical neuropsychology used VRs for assess- 
ment and intervention purposes [for reviews see 12,13]. 
The VR technique allows for both control of experimen- 
tal manipulations (e.g., different levels of complexity) 
and precise measures of subjects' responses [14] within 
relatively natural, immersive settings [15,16]. 

As cognitive functions are known to be altered by age 
[17], there is a considerable need for rehabilitation pro- 
grams in our aging society. In rehabilitation settings, 
shopping can be considered as one of the most import- 
ant activities to maintain and/or regain elderly people's 
and neurological and psychiatric patients' independent 
everyday life functioning [18-20]. In spite of their high 
relevance to successful rehabilitation for neurological 
and psychiatric patients, only few of these everyday ac- 
tivities, including shopping, have been implemented in 
computer-assisted training programs and VR applica- 
tions [21]. In an early report, Cromby et al. [20] investi- 
gated real life transfer of cognitive tasks learned in a 
virtual supermarket or other VR scenarios in students 
with learning difficulties using a two-week training inter- 
vention. In the experimental group, participants were 
presented with a shopping task in a virtual supermarket, 
while the control group was trained inside various VRs 
(e.g., a virtual house, a virtual city). The authors reported 
that the experimental group needed less time and 
bought more correct items in a subsequent shopping 
task in a real supermarket in comparison to the control 
group. Lee et al. [22] conducted a five day training in a 
virtual supermarket presented via a head-mounted dis- 
play. On a descriptive statistical level, they could show 
effects of learning during the course of the five day 
learning program, but they did not report any inferential 
statistics. Rand, Weiss and Katz [23] developed a virtual 
version of the Multi Errands Test [MET; 24], a standard- 
ized test to assess and train multitasking behavior in a 
real shopping mall, by adapting the MET into a virtual 
mall presented via a video capture system. In the MET, 
the participant has to run several different given errands, 
which require a strategic planning because of restrictions 
and rules to be followed (e.g., order of the errands, time 
restrictions, different opening hours). Using this VR- 
MET, the authors investigated effects of ten training 



sessions in four stroke patients. They observed a de- 
crease of rule breaks and non-efficient strategies in both 
the traditional and the virtual MET. Klinger et al. devel- 
oped a virtual supermarket task presented on a 17" LCD 
screen to assess executive functions in different patient 
groups. Action planning was measured during a shop- 
ping task, which required the participants to plan his/ 
her shopping according to a given shopping list [25]. 
Using this paradigm, the authors successfully showed in 
a number of studies impaired and spared aspects of ex- 
ecutive functions in patients with mild cognitive impair- 
ment [25], stroke [26], Parkinsons disease [27] and 
schizophrenia [28]. However, they did not report effects 
of training using their shopping task. 

Available data demonstrate that VR supermarkets can 
efficiently be applied for the assessment and training of 
cognitive functions. Previous studies applied virtual su- 
permarkets with relatively low resemblance to real life 
supermarkets [20] and the technical presentation was ra- 
ther simple (e.g., use of small LCD-screens). Also, previ- 
ous work has mainly focused on case study designs and 
descriptive statistics. Most importantly, VR supermarkets 
were used only for neuropsychological assessment, but 
not for training purposes. 

Based on the current state-of-the-art of VR applications 
in neuropsychological diagnosis and rehabilitation, we de- 
veloped a novel 360°- virtual reality supermarket displayed 
on a circular arrangement of 8 touch-screens - the 
"OctaVis" [29]. This 360°- apparatus allows for intuitive 
real world-like movements, as the participant is able to 
turn around and rotate freely and interact with virtual 
items by real world-like movements (e.g., reaching out 
with the arm and hand for articles). It offers the opportun- 
ity to display high-resolution 3D-graphics at 360°- field of 
view, which can be understood as an advantage over the 
aforementioned studies. The main aim of this study was to 
evaluate the efficacy of a new 360°- VR supermarket task 
for the ecologically valid assessment and training of cogni- 
tive functions. Therefore, we analyzed participants' per- 
formance and level of presence in our new 360°- OctaVis, 
using a virtual shopping task. We propose that our tech- 
nically more advanced presentation of the VR may induce 
stronger feelings of immersion and this will enhance the 
efficacy of training within the VR [30,31]. Our assumption 
is based on previous research showing positive effects of 
display size and participants' field of view on the subjective 
feeling of immersion [32,33]. In particular, we hypothesize 
that training in our 360°-VR supermarket will lead to sub- 
stantial learning in remembering and finding articles of a 
shopping list. Furthermore, learning of this list will not be 
interrupted by the introduction of a new, interfering shop- 
ping list. Finally, we assume participants' level of 
immersion into the VR and feasibility of our task to pre- 
dict levels of learning in our task. To address the issue 
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whether training effects are comparable in a clinical sam- 
ple, we also included a small sample of patients with focal 
epilepsy in our study. Due to the high incidence of mem- 
ory impairments in this clinical group [34,35], patients 
were considered to have a special benefit from our VR 
training program of memory functions in an everyday-like 
context. 

Methods 

Participants 

Participants were 19 healthy university students (5c?, 
14?). Mean age was 23 ± 3.45 (range 19 to 28 years). To 
ensure a homogeneous sample with average general cogni- 
tive functioning, we assessed participants' IQ. Mean IQ 
was 109.9 ± 8.58. Participants' medical history was 
assessed via a self-report questionnaire and a subsequent 
interview for detailed medical anamnesis. Participants with 
lifetime head injuries, severe medical illness, medication 
affecting the central nervous system, psychiatric diseases, 
and neurological diseases were excluded from the study. 
Also, participants with current consumption of illegal 
drugs or alcohol abuse were excluded. 

We also examined an additional small sample of pa- 
tients with focal epilepsy (n = 5). Mean age of patients 



was 35.04 ± 8.08 (range 25 to 47), mean IQ was 104 ± 
9.23. Additional file 1 provides a detailed overview of the 
patients' clinical and demographic data. In the clinical 
sample, neuropharmacological medication of epilepsy 
was not generally an exclusion criterion. However, pa- 
tients who were treated with substances causing memory 
disturbances were excluded from the study. 

Written informed consent was obtained from all sub- 
jects prior to participation, and the local ethics commit- 
tee approved the study. 

Protocol 

All healthy participants accomplished a five day training 
program in the VR (see Figure 1A). On day 1-3, subjects 
heard an auditorily verbal presentation of the same 
shopping list including 20 shopping items (list A). 
Thereafter, they were instructed to memorize and buy 
all items that had been presented. Participants walked 
through the supermarket and picked the learned shop- 
ping items out of the assortment of products of the VR 
supermarket. On day 1, before starting the VR shopping, 
participants accomplished a practice trial in a 3D room, 
which had the same size as the virtual supermarket, but 
did not include any articles and shelves. The main VR 
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Figure 1 Schematic overview of the VR training program used in the OctaVis. A) During the first three days, healthy participants had to 
memorize and buy items of a target shopping list (list A), which was auditorily presented at the beginning of the trials. On day four, a new, 
interfering list (list B) was presented and participants had to memorize and buy only items of this interference list. On day five, participants had to 
recall and buy only items of the target list A, but without any further presentation and learning of list A. B) For the epilepsy patients, an extended 
program was used. This included six days of learning, on which the patients had to memorize and buy items of an auditorily presented target list 
(list A). On day 7, a new, interfering list (list B) was presented and participants had to memorize and buy only items of this interference list. On 
day 8, participants had to recall and buy only items of the target list A, but without any further presentation and learning of list A. 
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experiment was only started after participants had ful- 
filled the criterion of successful operation in this training 
room (i.e., walking straight, turning around, walking in 
curves) and reported to feel comfortable with the con- 
trol system of the OctaVis. The required time for 
accomplishing the practice trial ranged from two to five 
minutes. Subjects were instructed to buy all items of the 
shopping list that they remembered as fast as possible, 
but without buying any products that had not been on 
the list. On days 2 and 3, list A was presented again to 
the participants, and the shopping task remained the 
same. On day 4, a different list was presented auditorily, 
which comprised 20 new shopping items (list B). List B 
was applied to induce interference into the training 
phase. Except for the novel shopping items, the task and 
the instructions remained the same. On day 5, partici- 
pants were instructed to buy all items of list A which 
they remembered as fast as they could, without a new 
presentation of list A. Subjects were thus required to re- 
call the shopping items of list A from the former learn- 
ing trials on day 1 to 3. Moreover, subjects were told not 
to buy any items of list B. Start and end points in the 
supermarket were fixed. All participants started at the 
turnstile at the entrance of the VR supermarket on every 
trial. To finish the experiment, participants had to move 
to the end of the central cash point and tell the exam- 
iner that they had completed the task when they felt that 
they collected all items that they remembered. Naviga- 
tion in the VR supermarket was not restricted besides 
real-life restrictions such as collision with shelves and 
walls of the supermarket. Participants could freely navigate 
through the VR supermarket, and there was no restriction 
of time to accomplish the task. Prior to the experiment, 
participants were told that they have to accomplish a 
shopping task, but they were not informed about details of 
the study design (e.g., target list, interference list, number 
of shopping products on each list). Moreover, they were 
informed about the daily and total duration of the experi- 
ment. While shopping, participants could not see the 
products that they had already bought. Both shopping lists 
included the same four different semantic categories: "bev- 
erages", "hygiene items", "groceries" and "households 
goods" with, each category containing five articles. 

For the epilepsy sample, we administered an extended 
eight-day version of our supermarket training program 
instead of the five-day training applied in healthy adults. 
This modification was implemented since even healthy 
volunteers were unable to remember and buy all 20 
items of the target list on day 3, that is, the day before 
the interference list was presented. The absence of ceil- 
ing effects in normal subjects indicates a rather high dif- 
ficulty of our VR shopping paradigm, which is sensitive 
for the differentiation between high and low performers 
in healthy young adults. It is therefore likely that a 



three-day learning of the target list may be too short for 
learning both target list items and orientation in the VR 
supermarket in a clinical sample. The extended 8-day 
training thus included 6 days of training of the target list 
(instead of 3 days) before the interference list was 
presented. Except the prolonged learning phase of the 
target list, the study design was the same as in the five- 
day program. Figure IB shows a schematic overview of 
the extended training program applied to patients with 
epilepsy. 

VR apparatus 

The VR was presented on a new 360°- VR apparatus, 
the "OctaVis" [29]. The OctaVis consists of eight 
LCD-touch-screens, which are arranged in a circle 
around the participant (Figure 2 A: OctaVis in a closed 
state; Figure 2B: OctaVis in an open state). Within this 
circle of eight screens the participant is sitting on a fixed 
swivel chair, which can be freely rotated. The orientation 
of the chair corresponds to the viewing and movement 
direction of the participant in the VR. Forward, backward 
and side movements are accomplished by using a "throttle 
joystick" (Metallux, Korb, Germany, www.metallux.de), 
which is installed on the chairs arm-rest (Figure 3B). By 
tapping the LCD touch-screens, participants select the 
products they want to buy (Figure 3A). All products in 
the supermarket (i.e., list A and B, and all other 
distractor products) can be bought by tapping on it. As 
every product in the supermarket was displayed in an array 
with multiple units of the same category, only the single 
product that is bought disappears from the screens, but the 
remaining items of the same category remain visible. 

Virtual Environment 

We used a virtual medium-sized supermarket, which 
had a structure comparable to that of a real supermarket 
(Figure 4). The VR supermarket was modeled according 
to a real standard supermarket in Germany with a size 
of 25 x 25 meters. All goods in the supermarket were 
designed referring to real brands and packages from 
common products that can be found in German super- 
markets. The VR supermarket included a total of 73 
types of products (i.e., comparable products of different 
brands; 20 items of list A + 20 items of list B + 33 filler 
items). These 73 types of products were available in dif- 
ferent subtypes or brands (e.g., the product "tea" was 
available as "green tea", "black tea", etc.), which resulted 
in a total of 243 different products (each belonging to 
one of the aforementioned 73 types of products; see 
Figures 3 and 4A). All products were available in multiple 
quantities (e.g., 72 units of green tea) such that the VR 
supermarket contained a total of 51.764 selectable items. 

None of the articles following directly one after the 
other in lists A or B were placed next to each other in 
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Figure 2 Structure of the OctaVis, in closed (A) and opened (B) state. The swivel chair is surrounded by a ring of eight LCD- touchscreens. 
Four speakers on top of the frame are used to provide auditory stimuli. 



the virtual supermarket. For acoustic stimulation, we used 
a low background sound, which before had been recorded 
in a real supermarket and consisted of sounds, which can 
be typically found in a supermarket (e.g., customers pass- 
ing by, announcements, customers' conversations). Sound 
files were provided via four stereo speakers, which were 
installed on top of the OctaVis (Genelec, Iisalmi, Finland, 
www.genelec.com, Figure 2). There were no virtual cus- 
tomers or other persons in the supermarket. 

Presence and immersion 

As the emergence of feelings of presence can be consid- 
ered as a result of individual characteristics of a person 



and/or properties of a particular virtual environment 
[31], we obtained two different measures of immersion: 

To investigate the participants' perceived level of pres- 
ence during the shopping situation in the virtual super- 
market (state measure of immersion), we applied the 
Presence Questionnaire [PQ; 36] after the first day of 
training (day 1) and, again, after the last day of training 
(day 5). The PQ is a self rating questionnaire that as- 
sesses participants' momentary level of presence, or the 
feeling of being immersed into a particular VR. Partici- 
pants' answers can be given on a 7-point Likert-scale. It 
is constructed to assess a multi-faceted construct of 
presence. In a principal components factor analysis, 




Figure 3 Detail view of the LCD-touchscreens (A) and the swivel chair (B) of the OctaVis. Items in the VR can be bought by tapping them 
on the screens. The items disappear from the screens after selection (A). Navigation in the VR is accomplished by chair rotation and the "throttle" 
joysticks for linear movement (B). 

V ) 



Grewe et al. Journal of NeuroEngineering and Rehabilitation 2013, 10:42 
http://www.jneuroengrehab.eom/content/1 0/1 /42 



Page 6 of 15 




Figure 4 Layout and design of the virtual supermarket displayed on the OctaVis. Two out of eight LCD-touchscreens providing a detail 
view of the virtual supermarket with three shelves and one aisle (A). The top view shows the complete layout of the supermarket from the bird's 
eye view (B). Note, that participants did not see the supermarket's top view as shown in (B). 



Witmer et al [36] revealed that four PQ-subscales ac- 
count best for the total variance data. These are "in- 
volvement", "sensory fidelity", "adaptation/immersion", 
and "interface quality". 

In addition, before beginning the VR training, partici- 
pants completed the Immersive Tendencies Question- 
naire [ITQ; 31]. The ITQ is a self-rating questionnaire 
assessing an individuals general tendency to get 
immersed into a virtual environment (trait measure of 
immersion). Trait measures of immersion can be highly 
different between individuals. In contrast to the PQ, the 
ITQ thus does not measure a current state of presence 
at a particular point in time. Therefore we applied the 
ITQ only at one time point. The items of the ITQ each 
comprise a 7-point Likert-scale and comprise three sub- 
scales: "involvement", "focus" and "games". 

To control for the occurrence of cybersickness, we also 
asked the participants whether they experienced symp- 
toms of vertigo as an indicator of feasible cybersickness. 

We also examined usability of both the task and the 
technical apparatus using a self-constructed explorative 
questionnaire, which included four items belonging to the 
"task"-subscale and four items belonging to the "tech- 
nique"-subscale (Additional file 2). The questionnaire was 
designed in style of the PQ and was given to the partici- 
pants directly after the PQ on day 1 and day 5. 

Finally, we assessed participants' figural memory with 
the Rey-Osterrieth Figure [ROF; 37] before the begin- 
ning of our program: Participants first had to copy a 
complex geometric figure (measuring visuo-constructive 
and planning abilities). Then, three and 30 minutes later, 
they were asked to freely recall this figure by drawing it 
again from memory. 

Measures 

For behavioral measures of performance in the virtual 
supermarket, we considered the time required by the 



participants to buy all the shopping items they remem- 
bered ("time") as well as the number of correctly picked 
items from the respective list ("correct products") the 
adjusted number of correctly picked items from the re- 
spective list ("product-score"; i.e., number of correct 
items minus false positives minus repetitions) and the 
length of movement trajectories ("LMT"). The LMT is 
given in meters and refers to the distance travelled in 
the VR supermarket by each participant to perform the 
task on each day. LMT accordingly represents the length 
of movement trajectories the participant would have 
traveled in a real 25 x 25 m supermarket. 

Since we mainly focused on the analysis of perform- 
ance of a healthy control group in our novel VR training 
program, we were particularly interested in behavioral 
raw measures on each single day of training. Our ap- 
proach of data analysis allowed us to assess in detail 
how performance changed between two single trials/days 
and on which stages of training significant changes of 
performance occurred. For the same reason, we were 
also interested in correlations between performance on 
single trials/days in our VR program and scores on 
standard neuropsychological tests of figural memory as 
well as measures of immersion. 

Statistical analyses 

All statistical analyses were conducted using SPSS 17 
(SPSS Inc., Chicago, Illinois). The general significance 
level was set to a = .05. To check for the assumption of 
normally distributed variables, we used the Kolmogorov- 
Smirnov-Test (a = .20). Associations between the measures 
of learning and the results of the applied questionnaires 
were calculated by using Pearson s correlation coefficient, 
r. Effects of learning in the course of the training were 
analyzed using matched pairs t-tests in the case of a 
comparison between two single days. The comparison 
between days 3 and 5 was calculated to test for potential 
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interfering effects of the distraction list B on free recall of 
the target list A. In cases where comparisons across more 
than two days were calculated, we used repeated measures 
ANOVAs. If the repeated measures ANOVAs revealed sig- 
nificant differences between trials, post-hoc comparisons 
for the differences between each single pair of days were 
conducted using dependent t-tests. Multiple post-hoc-com- 
parisons were corrected using Bonferroni adjustment. 
The Bonferroni adjusted significance level for the post- 
hoc-comparisons was a = .0083. 

Due to the small sample size (n = 5), nonparametric 
tests were chosen for the analyses including the clinical 
group. Thus, associations between two variables were 
calculated using Spearman's rho, p s . Comparisons be- 
tween single trials were analyzed using Wilcoxon signed 
rank tests. 

Results 

The Kolmogorov-Smirnov-Tests revealed non- signifi- 
cant results for all variables used in our analysis, thus in- 
dicating normal distribution of the variables. 

Efforts of learning 

There was an overall effect of learning over the course 
of the first three days of learning for the correct prod- 
ucts (WL = .191, F= 33.81, p < .001, rj 2 = .809; Figure 5A, 
left side) and the product-score (WX = .177, F = 37.29, 
p < .001, rj 2 = .823; Additional file 3). Furthermore, there 
was an overall effect of learning considering all five days 
of training including the distractive trial on day 4 for the 
correct products (WX = .157, F= 18.82, p < .001, 
rj 2 = .843; Figure 5A, left side) and the product-score 
(WL = .164, F= 17.9, p < .001, rj 2 = .836). Comparing par- 
ticipants' effort between two single days, there was a dif- 
ference for the product-score from one day to the next 
for all five days (adjusted a < .0083). For the correct 
items, there was a difference from one day to the next 
for all five days (adjusted a < .0083; Table 1). 

The participants' LMT decreased over the course of 
the three days of learning (WX = .614, F=5.03, p = .02, 
rj 2 = .386; Figure 5B, left side). This effect of learning was 
also observed considering all five days of training including 
the distractive trial on day of our five day program 
(WX = .506, F=3.42, = .038, rj 2 = .494; Figure 5B, left 
side). Particularly, there was a difference in the required 
LMT for the single runs between day 1 vs. day 2, day 4 vs. 
day 5 and day 1 vs. day 4 (adjusted a < .0083; Table 2). 

The required time for the single runs decreased over the 
course of the three days of learning (WL = .312, F= 17.6, 
^x.OOl, /7 2 = .688; Figure 5C, left side). This effect of 
learning was also observed considering all five days of 
training including the distractive trial on day 4 (WL = .23, 
F= 11.71, p < .001, rj 2 = .77; Figure 5C, left side). Particu- 
larly, there was a difference in the required time for the 



single runs between day 1 vs. day 2, day 2 vs. day 3, day 4 
vs. day 5 and day 1 vs. day 4 (adjusted a < .0083; Table 3). 

Immersion and presence 

Neither the total score of the ITQ nor one of the ITQ- 
subscales was correlated with the number of correct prod- 
ucts, the product-score, the LMT or the required time. 

The PQ total score increased from day 1 (M = 137.26, 
SD= 18.62) to day 5 (M= 143.89, SD= 13.47), but there 
was only a trend for a significant difference (£=-1.89, 
p = .075, d - .433). The PQ-subscale "immersion/ adapta- 
tion" increased from day 1 (M = 40.74, SD = 6.62) to day 5 
(M = 45.53, SD = 4.91; t = -2.76, p = .013, d = .632). 

The PQ-subscale "immersion/adaptation" was corre- 
lated with the required time on day 3 (r = -.569, 
p - .014), the product score on day 2 (r = .473, p = .047) 
and day 3 (r = .546, p = .019) and the number of correct 
products on day 3 (r=.551, p = .018). The PQ-subscale 
"sensory fidelity" was correlated with the product-score 
on day 1 (r = -.539, p = .021). The PQ-subscale "involve- 
ment" was correlated with the LMT on day 1 (r = .564, 
p = .015) and day 4 (r = .623, p = .006). Table 4 summa- 
rizes the main results of the correlational analyses. 

Figural memory 

Participants' mean T-Score in the immediate recall of the 
ROF after three minutes was 55.58 (SD = 10.43), the mean 
delayed recall after 30 minutes was 53.16 (SD =10.63). 

The immediate recall of the ROF was correlated with 
the product-score on day 5 (r = .484, p = .042). The de- 
layed recall in the ROF was correlated with the product 
score on day 5 (r = .527, p = .024), as well the number of 
correct products on 5 (r = .472, p = .048; Figure 6A). 
Table 4 summarizes the main results of the correlational 
analyses. 

Feasibility questionnaire 

The task-subscale of our explorative questionnaire signifi- 
cantly increased from day 1 (M = 17.53/28, SD = 2.39) to 
day 5 (M = 19.32/28, SD = 2.08; £=-4.04, p < .001, 
d = .927). The technique-subscale of our explorative ques- 
tionnaire significantly increased from day 1 (M = 22.58/28, 
S£> = 3.98) to day 5 (M= 27.74/28, S£> = 3.02; £=-4.19, 
/?<.001,d = .963). 

The task-subscale was significantly correlated was the 
LMT on day 1 (r = -.596, p = .009) and day 4 (r = -.631, 
p = .005) and the number of correct products on day 1 
(r = .476, p = .046). Table 4 summarizes the main results 
of the correlational analyses. 

On day 1, nine of nineteen participants reported signs 
of vertigo, on day 5 only two of nineteen participants 
reported signs of vertigo. None of the participants can- 
celled participation in our study due to vertigo. 
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Healthy adults 

A Correct products 



Epilepsy patients 




B Length of movement trajectories 




C Required time 





Figure 5 Different measures of performance in the VR task for the healthy subjects (left side of the panel) and the epilepsy patients 
(right side of the panel. A) The mean number of correctly bought products in the VR supermarket is shown for the five day program (left side) and 
for the eight day program (right side). B) The mean length of movement trajectories given in meters is shown for the five day program (left side) and 
for the eight day program (right side). C) The mean required time to buy all remembered products in the VR supermarket given in seconds is shown 
for the five day program (left side) and for the eight day program (right side). Error bars depict +/- 1 SD; "*" = significant difference between two days 
at p < .0083 (corrected for multiple comparisons); "+" = significant difference between two days using the non-parametric Wilcoxon signed rank test to 
test the main hypotheses for the clinical group, p < .05; "n.s." = non- significant comparison. 
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Table 1 Descriptive and inferential statistics of the 
correct products 



Comparison 



trial 


mean (SD) 


pair 


T 


df 


P 


day 1 


13.50 (3.13) 


day 1 vs. 2 


4.48 


17 


< .001* 


day 2 


1 7.00 (2.82) 


day 2 vs. 3 


3.58 


17 


.002* 


day 3 


18.17 (1.89) 


day 3 vs. 4 


-3.82 


17 


.001* 


day 4 


15.33 (2.77) 


day 4 vs. 5 


3.01 


17 


.008* 


day 5 


1 7.56 (2.20) 


day 1 vs. 4 


2.02 


17 


.060 






day 3 vs. 5 


-1.45 


17 


.165 



SD = Standard deviation; df = degrees of freedom; * = significant difference at 
p <.0083 (adjusted for multiple comparisons). 



After the last training trial on day 5, participants were 
asked whether they used any kind of strategy to remem- 
ber the items of the lists during the experiment via a 
self-constructed questionnaire. In particular, they were 
firstly asked whether they had applied any kind of 
strategy to remember the items of the shopping lists. 
If the application of any strategy was affirmed, partic- 
ipants had to describe and write down the applied 
strategy by their own words. Multiple answers were 
allowed. The following strategies were mentioned by 
the participants: "Dual-coding" (i.e., the association of 
verbal information with visual-spatial information [design 
of each product and/or its localization in the VR 
supermarket]; 41%), "semantic clustering "(17%), "recogni- 
tion" (6%), "verbal rehearsal" (6%), "serial clustering" (6%), 
"body-part method" (i.e., association of items with parts of 
the body; 6%), "counting of products" (6%), other (12%). 

Results of the clinical sample 

Because of the small sample size, learning efforts across 
the eight day training program could not be calculated 
by repeated measurement ANOVAs. However, Figure 5 
(right side) provides an explorative overview of the 
learning efforts (i.e., correct products, LMT, and time) of 
the clinical group. Concerning the main hypotheses, par- 
ticipants bought more items on day 7 {median = 12, 
range = 4) in comparison to day 1 (median = 9, range = 5; 
Z = 2.04, p = .042; Figure 5 A, right side). The required 
time for shopping decreased from day 6 (median = 235, 
range = 575) to day 8 (median = 187, range = 64; Z = 2.02, 
p = .043; Figure 5C, right side). The LMT and the num- 
ber of correct products did not differ between day 6 and 
day 8. There was a trend for a correlation between the 
number of correctly bought products on day 8 and 
the immediate (p s = .872, p = .054) and the delayed recall 
(p s = .872, p = .054; Figure 6B) of the ROF. 

Discussion 

In this study, we investigated the feasibility of a VR 
supermarket application presented in the OctaVis, a 



Table 2 Descriptive and inferential statistics of the length 
of movement trajectories 



Comparisons 


trial 


mean (SD) 


pair 


T 


df 


P 


day 1 


283.72 (139.49) 


day 1 vs. 2 


-3.10 


17 


.006* 


day 2 


181.91 (55.06) 


day 2 vs. 3 


-.69 


17 


.496 


day 3 


175.19 (41.04) 


day 3 vs. 4 


2.25 


17 


.038 


day 4 


201.5 (53.92) 


day 4 vs. 5 


-3.31 


17 


.004* 


day 5 


164.83 (33.57) 


day 1 vs. 4 


-3.21 


17 


.005* 






day 3 vs. 5 


-1.41 


17 


.178 



Descriptive values are expressed in meters; SD = Standard deviation; 

df = degrees of freedom; * = significant difference at p <.0083 (adjusted for 

multiple comparisons). 



novel 360°- VR apparatus, for the assessment and training 
of neuropsychological functions in a sample of healthy 
young adults and a small clinical sample of patients with 
focal epilepsy. Healthy participants learned a list of 
shopping articles and subsequently bought them in a 
virtual supermarket on three consecutive days. On day 4, 
participants learned and bought items of a new, distractive 
list. Finally, on day 5, participants had to buy only the 
items of the target list, but without a new presentation of 
this list. Results show increasing levels of learning 
throughout the task as well as high levels of subjects' 
immersion in the VR. Moreover, performance in our task 
was significantly correlated with a measure of figural- 
spatial memory. The time needed for completion of the 
shopping task was significantly longer on day 1 than on 
day 4 (application of the distractive list B), indicating that 
visual- spatial familiarity with the structure of the super- 
market decreased the immediate distracting effect of list 
B. Also, we did not observe a decrease of performance 
from day 3 to day 5, thus indicating that learning was not 
significantly interrupted by the introduction of a new 
interfering list. Importantly, immersion was positively cor- 
related with the number of correctly bought products, 
suggesting that immersive feelings may enhance cognitive 
performance in everyday-like neuropsychological tasks. 

In the course of training in the OctaVis, there was a con- 
siderable improvement of cognitive performance across 
training sessions. This effect of learning was observed for 
several concurrent measures: Participants successively 
needed less time and shorter movement paths to accom- 
plish the task and bought a higher number of correct 
products, which was even valid when correcting for incor- 
rect products and repetitions. Moreover, performance of 
the ROF was positively correlated with the number of cor- 
rectly bought products. Finally, our main findings could 
be replicated in our clinical sample showing (a) compre- 
hensive and stable learning, (b) no negative effect on per- 
formance after the introduction of the interference list, 
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Table 3 Descriptive and inferential statistics of the 
required time 



Comparison 



trial 


mean (SD) 


pair 


T 


df 


P 


day 1 


422.06 (146.5) 


day 1 vs. 2 


-4.76 


17 


< .001* 


day 2 


265.06 (87.12) 


day 2 vs. 3 


-3.84 


17 


.oo r 


day 3 


219.22 (68.83) 


day 3 vs. 4 


2.80 


17 


.012 


day 4 


260.72 (64.26) 


day 4 vs. 5 


-5.45 


17 


< .001* 


day 5 


184.94 (44.72) 


day 1 vs. 4 


-6.03 


17 


< .001* 






day 3 vs. 5 


-2.79 


17 


.012 



Descriptive values are expressed in seconds; SD = Standard deviation; 

df= degrees of freedom; * = significance of difference at p<.0083 (adjusted 

for multiple comparisons). 



and (c) and association of measures of VR performance 
and the ROF in our patients with epilepsy. 

We suppose that these comprehensive results of learn- 
ing do not only reflect verbal learning as a consequence 
of the repeatedly presented shopping-list. Rather, im- 
provement on the different but converging measures 
support the view that learning occurred mainly on ver- 
bal, visual-spatial, executive, and familiarity levels [20]. 
Although our data do not directly allow for conclusions 
on multi-layered learning, we propose that successful 
learning in the VR shopping task depends on the inte- 
gration of at least verbal and visual-spatial modalities of 
learning, that is, a form of dual-coding. Moreover, the 
task requires executive abilities, in particular, visual- 
spatial planning strategies. This view is supported by the 
correlations between the ROF and learning scores in our 
VR task. The ROF represents visual-spatial memory 
functions, which are mostly independent of verbal abil- 
ities [38]. Besides visual-spatial memory abilities, the 
ROF also requires planning and structuring abilities and 
has correspondingly been used as a measure of planning 
and organization in previous studies [39-45]. We there- 
fore propose that the correlation between our task and 
the ROF might represent the tasks requirement of at 
least verbal learning and non-verbal figural learning, as 
well as executive abilities, thus supporting our argument 
of multi-layered learning in the VR supermarket. Fur- 
thermore, our idea of a multi-layered learning process is 
also supported by the strategies participants used to ac- 
complish the task. The use of dual coding, which implies 
the dual coupling of words of the shopping list with the 
visual representation of the respective product in the VR 
supermarket, was the memory strategy that was most 
frequently reported by our participants. It is most likely 
that the VR shopping task also makes demands on 
visual-spatial orientation and way-finding. However, our 
data do not contribute to this issue such that this as- 
sumption remains speculative. In our study, we did not 
aim at offering a full psychometric validation of our 



Table 4 Person correlations between VR performance and 
measures of immersion, figural memory and task feasibility 



PQ Immersion ROF 30' recall Feasibility 



Product-Score 


Day 1 


.258 


.365 


-0.83 




Day 2 


.473* 


.289 


.048 




Day 3 


.546* 


.415 


.059 




Day 4 


-.188 


.242 


.178 




Day 5 


.218 


.527* 


.249 


Time 


Day 1 


-.097 


-.109 


-.357 




Day 2 


-.404 


-.055 


.226 




Day 3 


-.569* 


-.262 


-.041 




Day 4 


-.210 


-.066 


-.200 




Day 5 


-.173 


.092 


.044 


LMT 


Day 1 


-.167 


-.277 


-.596* 




Day 2 


-.054 


-.074 


-.091 




Day 3 


-.167 


-.355 


-.321 




Day 4 


.143 


-.414 


-.631* 




Day 5 


.145 


-.011 


-.378 



Values represent Pearson correlation coefficients; PQ Immersion = Presence 
Questionaire subscale "immersion/adaptation"; ROF 30' = delayed recall of the 
Rey Oesterrieth Figure; Feasibility = questionnaire subscale "task"; 
LMT = Length of movement trajectories. 
* = significant correlation at p < .05. 



novel instrument. Furthermore, procedural learning and 
habituation to both technical control of the shopping 
task and the visual spatial structure of the VR environ- 
ment may also have contributed to efficient learning. 
Eventually, our idea of a multi-layered learning that took 
place in our VR task goes in line with the concept of 
multiple memory systems that represent different sub- 
types of memory and learning processes [6,46,47] . 

Interestingly, the data show evidence for further learn- 
ing from day 1 (first entering the supermarket) to day 4 
(entering the familiar supermarket after having heard a 
new shopping list) for the time required for the shop- 
ping task and the LMT, but not for the product-score. 
This decrease of time and LMT on day 4 (relative to day 
1) indicates that figural-spatial learning of the supermar- 
kets routes and layout occurred, which may be relatively 
independent of verbal memory of list A articles and their 
localization in the supermarket. This dissociation be- 
tween verbal and figural-spatial learning further con- 
firms our aforementioned idea of multi-layered learning. 
In particular, we suppose that participants created a cog- 
nitive map [48,49] of the virtual supermarket. Previous 
studies are in accordance with this assumption. The idea 
that generation of cognitive maps could be enhanced by 
learning in a VR [50], was supported by Tong et al. [51] 
who found that active performance in a VR-pathfinding 
task enhanced the accuracy in a subsequent drawing of a 
cognitive map of the landmarks in the VR. Results thus 
suggest that visual-spatial learning might have played a 
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Figure 6 Correlations between the delayed recall of the ROF and the number of correct products for the healthy adults (A) and the 
epilepsy patients (B). The x- axis represents the delayed recall of the ROF after a 30' delay and is given in T-Scores (M = 50, SD= 10). The y- axis 
represents the free recall of the target list on day 5 (A) and day 8 (B), respectively. ROF = Rey-Osterrieth Figure. 



central role for task performance in our task besides ver- 
bal learning of the products. This assumption is in good 
accordance with the frequent application of dual- coding 
strategies reported by the volunteers (i.e., verbal and 
visual-spatial representation). 

Insofar, our results are in line with a study of Brooks 
et al. [52], who found a dissociation between object and 
spatial learning in a VR. While the spatial layout of the VR 
could be recalled more accurately by participants who ac- 
tively (vs. passively) navigated through the VR, the mere 
learning of objects placed in a VR was independent of (ac- 
tive vs. passive) navigation in the VR [52] . Moreover, in a 
study of patients with traumatic brain injury, Matheis 
et al. [53] found a dissociation between patients' impaired 
list learning and spared visual memory performance. 

We propose that learning of the layout of the VR super- 
market took place on the first two days of training since 
the data show the highest increases of performance from 
day 1 to day 2. Moreover, the interference list did not 
affect performance in our VR shopping paradigm. Thus, 
there were no significant differences between all measures 
of performance on day 3 and day 5 (i.e., product-score, 
LMT, and time). Hence, our initial hypothesis that learn- 
ing will not be interrupted by the introduction of a new 
shopping list was corroborated by the data, that is, shop- 
ping performance of the target list was comparable on 
days 3 and 5, although we inserted new learning materials 
in between these trials. It is therefore reasonable to as- 
sume that visual-spatial learning supported the emergence 
of a multi-layered representation of the shopping articles 



included in the target list. Importantly, we replicated this 
result in our preliminary study of the small clinical sample 
of patients with focal epilepsy. This argues in favor of a 
stable and robust representation of learned multi-layered 
information after an initial learning phase of the visual- 
spatial layout of the VR supermarket in both healthy con- 
trols and clinical samples. 

For our present data, we suppose that interaction with 
the highly immersive 360°- VR OctaVis may have prompted 
multi-modal learning. There is considerable evidence from 
studies in children and adults that multi-modal learning is 
more efficient, deep and stable over time than unimodal 
learning [54-58]. Multi-modal learning may also enhance 
the feeling of presence and learning in VRs [59,60]. In 
addition, combined training of multiple cognitive functions 
could be shown to be an efficient strategy for rehabilitation 
of memory problems [61]. It is reasonable to assume that 
both the realistic layout of the supermarket and the real-life 
like interactive movements (e.g., turning around, reaching 
out with the arm and hand for an article) may have sup- 
ported the integration of visual-spatial and motor learning, 
and therefore facilitated the formation of episodic in con- 
trast to mere semantic memory contents [62], which makes 
our task a more precise measure of real-life cognitive per- 
formance. Most likely, immersion in the VR is a key player 
in the emergence of efficient multi-modal learning since it 
builds up the basis for real-life like integration of visual per- 
ception, motor-action and visual-spatial memory [52,63]. 

With regard to immersion, we observed increasing 
levels of subjective immersive feelings during the course 
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of our training program in the 360°- VR supermarket. 
Insofar, our results are in good agreement with Lee et al 
[22] who could also show participants' increasing levels 
of subjective immersion into the VR in the course of a 
five day intervention. In our study, it is likely that partic- 
ipants became more and more familiar with the super- 
market and the task and could thus successively 
immerse better into the VR during the course of the 
training intervention [64,65]. Increase of immersion may 
well be related to learning success. The correlations be- 
tween measures of learning (i.e., product-score, time) 
and intensity of immersion, which both increased during 
the course of the task further supports this view. Our re- 
sults provide first evidence that learning success depends 
at least in part on subjective immersive feelings. Eventu- 
ally, our results are in accordance with the findings of 
previous studies showing that intense feelings of 
immersion may be associated with higher levels of task 
performance in a more general sense [31] and better 
treatment success in psychotherapy settings where VR is 
used to cure different forms of phobias [30] . 

As in previous VR studies using the PQ [22,66-68] we 
observed relatively high levels of immersion. On the one 
hand, this further underlines our apparatus' technical 
feasibility for presenting highly immersive VR. We par- 
ticularly assume that participants' immersion was at 
least in parts enhanced by our novel apparatus with its 
specially designed 360°- view, the multi-sensory (i.e. vis- 
ual, motor and auditory) design and the intuitive and 
interactive control. This is in line with several former re- 
search showing positive effects of field-of-view size 
[32,33], multi-modal integration [69] and active control 
on immersion [70]. On the other hand, it can be also 
supposed that the high levels of immersion found in our 
study will beneficially contribute to feasible transfer ef- 
fects as immersion is thought to be a critical factor to 
enhance transfer from VR to real-life situations [71]. 

In contrast to these correlational associations between 
momentary presence and immersion measured with the 
PQ and task performance in the OctaVis, we did not 
find any association between performance in the OctaVis 
and the scales of the ITQ. Thus, a subject's individual 
tendency for immersion was not found to be a critical 
factor for our VR training paradigm. We therefore con- 
clude that performance in our paradigm mainly depends 
on the momentary level of immersion into the VR (as 
assessed with the PQ), rather than on a subject's general 
personal trait or capability to get involved or immersed 
(as assessed with the ITQ). This aspect is of high im- 
portance for a future routine clinical application of VR 
scenarios in the OctaVis since the efficiency of training 
in the OctaVis should accordingly be independent of a 
person's individual trait to get immersed into VR. This 
distinction allows for successful application of our 



program to a wider range of participants and does not 
restrict the application to participants with computer ex- 
perience. Certainly, a further investigation examining a 
sample with a wider range of ages would add important 
information to this issue. 

As it is important to use generally valid, "cross-media" 
measures of presence as well as specific measures that fit 
the proper and special technical features of the VR and its 
control devices [72], we also looked at the way participants 
subjectively got along with our particular task (represented 
by the task-subscale) and the technical apparatus (repre- 
sented by the technique-subscale). We observed high 
scores in both subscales, which even increased signifi- 
cantly in the course of our program and were correlated 
with measures of learning in the VR task, thus indicating 
both an easy-to-handle control of our technical devices as 
a training program that seems intuitive and easy to handle. 
However, our questionnaire's design was of explorative na- 
ture and scores may not be interpreted in terms of esta- 
blished measurements. 

In summary, our findings provide preliminary evidence 
that our novel VR supermarket paradigm presented in 
the OctaVis may efficiently be applied for the assessment 
and training of real-life cognitive functions in healthy 
subjects and patients with focal epilepsy. However, we 
acknowledge some limitations and caveats interpreting 
our study. First, we did not control for each of the pro- 
posed levels of learning in particular. For example, we 
could not assess a verbal list learning paradigm as this 
would have interfered with the learning in our virtual 
paradigm. Although our study does not claim to offer a 
full-scale validation study, the application of additional 
specifically related "traditional" neuropsychological tests 
(e.g., of verbal memory) would presumably have added 
important information about single cognitive processes 
involved in performance in our novel VR paradigm. In 
particular, a labyrinth task needs to be included in future 
studies to assess the roles of visual-spatial orientation 
and way-finding in the VR shopping task. Moreover, list 
learning paradigms like the California Verbal Learning 
Task [73] or the Verbal Learning- und Memory Test [Ger- 
man adaptation of the Auditory Verbal Learning Test; 74], 
which comprise the most established measures of verbal 
memory [75], might offer important information on the 
role of verbal memory in the VR shopping task. Thus, the 
question whether both verbal and visual memory pro- 
cesses might have played a role could have been adressed 
more directly. In future experiments, we will hence offer 
additional measures of verbal memory performance. Sec- 
ond, our results should be replicated with a sample of 
older participants to evaluate generalization of our results 
to a group of participants with less computer experience. 
We did not directly address the participants' motivation 
during shopping in the VR supermarket on each day of 
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training. It is reasonable to assume that besides cognitive 
capacity, different levels of motivation and effort could 
have had an influence on the participants' performance in 
the VR supermarket. Moreover, participants' experience of 
cybersickness needs to be considered as another con- 
straint of our study. Using a questionnaire on experiences 
of cybersickness we aimed at identifying sources of 
cybersickness during training in the OctaVis. Most partici- 
pants reported a flicker in their peripheral field of view as 
an eliciting factor of nausea. This flicker is mainly technic- 
ally related to fast movements in the VR, a relatively low 
frame-rate of the VR system (i.e. a low speed of re- 
generation of the VR environment), and the large field of 
view [76]. In our current studies of training in the OctaVis, 
we have accelerated the frame-rate and limited the max- 
imum speed of movement inside the VR to reduce symp- 
toms of cybersickness elicited by these factors. These 
changes of technical parameters resulted in a considerable 
reduction of reports of cybersickness. Finally, our tasks 
psychometric properties must be further evaluated. There- 
fore, we will apply the OctaVis to different populations to 
examine its validity in laboratory and further clinical set- 
tings. We currently elaborate different forms of feedback, 
which can be suitable for different patient groups. In 
parallel, we compare our VR program with already es- 
tablished training paradigms. 

Conclusions 

Based on diverse concordant measures of visual-spatial, 
strategic, and verbal cognition, we showed evidence for a 
comprehensive and multi-layered learning success in the 
course of the training. Correlations between measures of 
multi-layered learning and scores on classical neuro- 
psychological tests of visual-spatial cognition corrobor- 
ate the view that our findings do not only depend on 
verbal learning of the shopping list. Moreover, we were 
able to demonstrate the feasibility of the VR supermar- 
ket paradigm presented in the OctaVis by high scores on 
both an established presence questionnaire and a self- 
constructed questionnaire, which was specifically related 
to our technical device. Importantly, we also provide 
strong evidence of a relation between the level of 
immersion and task performance. We conclude that we 
have developed and tested a novel 360°- VR environ- 
ment, which demands real world-like visual-spatial and 
motor actions and thus allows for the training of the re- 
spective cognitive abilities. Importantly, results of our 
sample of patients with focal epilepsy corroborate the 
main findings of our basic healthy sample, thus giving 
preliminary evidence of a replication of comparable ef- 
fects in a clinical sample. We propose that our technical 
device and neuropsychological paradigm can efficiently 
be used for assessment and training of real life-based 
cognitive functions. Future studies providing both 



additional validation data and clinical evidence are 
needed to corroborate the efficiency of cognitive training 
interventions in the OctaVis in patients with different 
neurological and psychiatric diseases. 
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